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Claims 



What is claimed is: 

1 . A method for processing video, the metjfcd comprising the steps of: 

determining an association between a first video segment including a particular feature 
5 and at least one additional information sourcp also including that feature; and 

utilizing the association to ifisplay information from the additional information source 
based at least in part on a selection by/ user of the feature in the first video segment. 
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2. The method of claim 1 wherein the det^nnining step further includes the step of retrieving 
10 the association from a memory. 

3. The method of claim 1 wherein the determining step further includes determining the 
association from information in a nprtion of the video segment. 

15 4. The method of cla^m 1 wherein the additional information source comprises an additional 

video segment also including the feature. 

5. The methoa of claim 4 wherein the utilizing step includes switching from display of the 
first video segmen^o display of the additional video segment also including the feature. 
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6. The method of claim 4 wherein the utilizing step includes displaying the additional video 
segment at least in part in a separate portion of a display which also includes at least a portion of the 
first video segment. / 

7. The method of claim 1 wherein the feature is a video feature extracted from at least one 
frame of the video segment. / 

8. The method of claim 7 wherein th/e video feature comprises at least one of a frame 
characterization, a face identification, a scene identification, an event identification, and an object 
identification. / 

9. The method of claim 1 wherein the feature is an audio feature extracted from at least one 
frame of the video segment. / 

10. The method m claim 9 wherein the utilizing step includes combining an audio signal 
corresponding to the apdio feature with an audio signal associated with the first video segment, 
video segment, or transcribed in a textual format and displayed along with the video segment. . 

1 1. The method of claim 9 wherein the utilizing step includes converting an audio signal 
corresponding to the audio feature into a textual format which is displayed with the first video 
segments 
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12. The method of claim 9 fiirther including separating a^east a portion of the video segment 
into audio categories including one or more of single-voico4peech, multiple-voice speech, music, 
silence and noise in order to extract the audio feature therefrom. 

13. The method of claim 9 wherein the axpio feature comprises at least one of a music 
signature extraction, a speaker identification, and/a transcript extraction. 

14. The method of claim 1 wherein jme feature is a textual feature extracted from at least one 
frame of the video segment. / 

15. The method of clainpi 14 wherein the utilizing step includes displaying information 
corresponding to the textual iim)rmation as an overlay on a display of the first video segment. 

16. The method fi)f claim 1 wherein the determining step further includes determining the 
association based at least in part on at least one multi-dimensional feature vector extracted from a 
portion of the video /egment using a feature extraction technique. 

17. Ther method of claim 1 wherein the determining step fiirther includes determining the 
association ba^ed at least in part on at least one of a similarity measure and a clustering technique. 
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61^^18. An apparatus for processing video, the appa^tus comprising: 

a memory for storing an association netween a first video segment including a 
particular feature and at least one additional informafton source also including that feature; and 

a processor coupled to the memory and operative to utilize the association to direct 
the display of information from the additional information source based at least in part on a selection 
by a user of the feature in the first video segment/ 

19. An apparatus for processing video, the apparatus comprising: 

a processor operative (i) to determine an association between a first video segitfent 
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W including a particular feature and at least on jadditional information source also including that feature; 
and (ii) to utilize the association to display^information fi-om the additional information source based 
at least in part on a selection by a user ofithe feature in the first video segment. 



20. An article of manufacture comprising a machine-readable medium containing one or more 

S . / . 

^tS software programs which when executed implement the steps of: 

determining an association between a first video segment.including a particular feature 
and at least one additional information source also including that feature; and 

utilizing the association to display information fi'om the additional information source 
based at least in part on a select^n by a user of the feature in the first video segment. 

20 

21. A method for processing vicfeo, the method comprising the steps of 
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determining from information in a portion of a first video segment an association 
between a particular feature of the first video segment and at least one additional information source 
also including that feature; and / 

utilizing the association to display inffirmation from the additional information source. 

22. An apparatus for processing video,ihe apparatus comprising: 

a processor operative (i) to detlermine from information in a portion of a first video 
segment an association between a particular feature of the first video segment and at least one 
additional information source also including that feature; and (ii) to utilize the association to display 
information from the additional informayon source. 

23. An article of manufacture comprising a machine-readable medium containing one or more 
software programs which when executed implement the steps of: 

determining from information in a portion of a first video segment an association 
between a particular feature of the first video segment and at least one additional information source 
also including that feature; and / 

utilizing the association to display information from the additional information source. 
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